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The Deductive Logical Competence of Non-graduate 

Caribbean Teachers 



Introduction 

This paper reports data on some aspects of the deductive 
logical competence of non-graduate teachers in the English- 
speaking Caribbean, primarily Jamaica. It is intended to 
complement and extend the work reported in Nolan and Brandon 
[10] on levels of competence among secondary school children 
in Jamaica on various types of conditional reasoning. 



The Sample 

The teachers sampled were those who sat entrance 
examinations for the UWI , Mona, Faculty of Education B.Ed, 
and Cert. Ed. programmes from 1985 to 1989. These people are 
teachers who have been trained in regional teacher training 
colleges and are still working in the school system of their 
territory. At the time of sitting the examination, the 
majority are working in the primary sector, though many of 
those applying for training in specific secondary subjects 
are already working in the secondary sector, and many 
successful applicants will return to that sector, or even to 
teacher training itself. 

Given that none of the territories can boast a large 
graduate teaching force, these applicants are not untypical 
of teachers in their context, in particular they are fairly 
representative of the sort of teachers the majority of 
students are likely to meet. They are perhaps mainly unusual 
in that they are trying to improve their lot through further 
teacher training. But while in very general terms the 
teachers sampled are not unusual, they do not constitute good 
samples when broken down by such factors as sex. In this 
particular case, males dominate in administrative positions 
and are found mostly in the secondary sector, and it is from 
such backgrounds that _he vast majority of the male 
applicants come. The data are almost certainly skewed also 
with respect to geographical distribution since rural 
isolation or sheer distance from the Mona campus is probably 
enough to deter many teachers. In this respect it should 
also be noted that the representativeness of these applicants 
is much stronger for Jamaica than for the other territories 
whose teachers might in most cases seek to apply to other 
campuses of the UWI. 

Tables 1 and 2 give a breakdown of the five batches of 
teachers. It is possible that the same person can sit the 
entrance examination on different occasions, and it is known 
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Table 1: Applicants, by programme, sex and territory, 1985-89 



N 
N 



Anguilla 

Antigua 

Bahamas 

Barbados 

Belize 

C.O.B. 

Dominica 

Grenada 

Guyana 

Jamaica 

St Kitts 

St Lucia 

St Vincent 

Trinidad 

Other 



N 

N 



Anguilla 

Antigua 

Bahamas 

Barbados 

Belize 

C.O.B. 

Dominica 

Grenada 

Guyana 

Jamaica 

St Kitts 

St Lucia 

St Vincent 

Trinidad 

Other 



1985 
622 

B.Ed. Cert. 
247 375 



M 


F 


M 


F 


57 


188 


67 


308 


1 




1 


8 




1 


2 


9 


2 


2 


1 


3 


6 


27 






1 


1 






38 


149 


46 


270 


5 






3 


2 


4 


7 


10 


2 


1 

3 


10 


3 



1986 
472 

B.Ed. Cert. 
179 293 
M F M F 

46 132 69 224 

118 

4 10 
3 6-1 
3 18 

3 12 



35 98 30 148 
4 2 4 11 
1 7 27 34 



1987 
361 

B.Ed. Cert. 
224 137 
M F M F 

43 181 3 2 105 
1 

12 14 
1 
6 

2 3 11 

3 18 

1 2 13 

12-1 
1 

31 152 21 69 
1 

2 13 5 
1 - 1 
1-35 



1988 
594 

B.Ed. Cert. 

389 205 
M F M F 

84 305 32 173 

2 17 
1 2 

2 1 
5 19 

2-7 

3 4 

72 276 22 127 
4 

1 3 1 15 

2 3 1 

2 



1989 
622 

B.Ed. Cert. 

385 237 
M F M F 

78 307 37 200 

1 34 

- 2 2 7 

3 111 
7 29 

1 1 5 
1-12 

63 269 24 139 

4 2 3 9 

- 3 4 3 



Note: in 1985, two B.Ed, candidates did not give their sex; similarly in 
1986, one candidate. C.O.B. stands for the College of the Bahamas; 
candidates classified as "other" are probably from Turks and Caicos. 



Table 2: Applicants, by specific programme, 1985-89 





1985 




1986 


1987 


1988 


1989 


B.Ed, total 


247 




179 


224 


389 


385 


Administrate 


- 






57 


111 


96 


Primary 








r Q 
Z> O 


19 9 
± Z Z 


1 fiA 
1UD 


English 


- 




- 


23 


32 


39 


int. science 








n 
I 




9 n 
z u 


Maths 








16 


31 


30 


Reading 


- 




- 


9 


7 


10 


Soc Studies 






- 


_ 


21 


14 


Spanish 


- 




- 


1 


1 


2 


Special Ed. 


- 




- 


23 


27 


32 


C.O.B. 


33 




22 


21 


24 


36 


Cert. Ed* total 


375 




293 


137 


205 


237 


Administration 








9 


55 


18 


English 


53 




35 


22 


27 


29 


Int. Science 


40 




33 


11 


7 


9 9 
Z Z 


Maths 


59 




62 


30 


40 


46 


Reading 


200 




134 


56 


52 


83 


Religious Ed. 






15 


4 


3 


5 


Soc Studies 


20 




11 


5 


20 


33 


Spanish 


3 




3 




1 


1 


Note: B.Ed, candidates 


were 


not classified by 


specia lizat ion 


until 19 


that several of 


those 


persons a 


pplying 


to study B.Ed. 


special 


subjects 


had already 


taken the 


examination when previously 


applying 


for the 


Certificate programme . 


No attempt has been 


made to 


identify 


such 


repeaters 


* 







In the course of this report mention will sometimes be 
made of other related investigations. These include groups 
of Jamaican school children who were given versions of the 
tests used in the entrance examination and also similar 
groups and a group of teacher trainees in St Lucia who were 
given a test which was mostly concerned with different 
principles . 



Principles of Deductive Logic 

Deductive logic studies those situations, typically but 
not only in a context of argument, in which a given set of 
statements (possibly empty) , the premises, necessitates 
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another set, the conclusion, that is to say, ij£ the premises 
were true then the conclusion would have to be true too. An 
argument in which this happens (or more generally, the 
inference in any such case) is labelled valid . Very many 
such situations depend only on the structure of the 
statements involved and not upon their semantic content, so 
that deductive logic can be studied as a matter of form: the 
argument every A is a B, x is an A, so x is a B is 
deductively valid, no matter what one is talking about 
(humans, mortality and Socrates in the stock example, or 
equally well whales, mammals, and the whale stranded on your 
local beach) . Just as one can identify valid forms of 
argument so one can pick out argument structures that do not 
fit the criterion (in which the premises could all be true 
while the conclusion is false) , although they might seem to 
be valid. Such structures are deductively invalid arguments; 
many of what are called fallacies exemplify such deductively 
invalid principles of reasoning. 

The investigations reported here have been based on the 
extensive work carried out in the US by Robert Ennis and his 
associates on competence in simple deductive logic (Ennis and 
Paulus [5]). In particular their approach to the 
identification of distinct principles of valid or invalid 
argument has been retained. The example cf valid argument 
given in the previous paragraph would then count as one 
(symbolically expressed) case of a particular principle, 
other cases being given by replacing the symbols with words 
uniformly through the argument. 

In Ennis 1 tests, and in these investigations, six 
examples of each such formally identified logical principle 
are given. Respondents are held to have mastered a principle 
if they get at least five of these questions right; they are 
considered on the borderline if they get exactly four of them 
right. It should be noted that on this approach a person may 
be considered to have mastered a valid principle, say, even 
though he has not grasped how it differs from a similar but 
invalid one. As has been noted elsewhere (Brandon [2]), a 
stricter view would drastically cut the number of persons who 
could be regarded as having mastered any logical principle at 
all. 

Logical principles can be grouped in various ways. The 
first and crucial criterion is validity or invalidity. The 
other main way is by reference to their major structural 
components. Thus one can distinguish various principles 
focussing on conditional statements (such as all the 
principles used in Nolan's pioneering work in Jamaica, Nolan 
[9], and in the report mentioned above, Nolan and Brandon 
[10]) or quantifiers (words for how many, all , some, mos t , 
etc.) or disjunctive statements, and so on. 
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An interesting and unusual feature of the investigations 
reported here is that two principles involving the plurative 
or pleonetetic (Geach's terms [6]) quantifier most have often 
been used. This quantifier is not normally studied in 
elementary formal logic , even though its meaning is perhaps 
closer to what we often intend in using plurals or the 
universal quantifier all than how that universal quantifier 
is itself construed in formal logic (cf. Hodges [7], p. 196). 

A couple of other "principles" have been used in the 
investigations, although they do not fit the characterization 
given above. One such was a set of items depending on 
general properties of relational expressions, the other on 
simple mathematical relationships. In both cases, the set of 
six items was composed of three valid cases and three 
invalid, so these "principles" have been treated very 
differently from the rest. 



The Instruments 

Each entrance examination has contained a paper with a 
section consisting of 36 items in the standard Ennis format; 
suppose you know that .... then would it be true that . • . . ? 
Three possible answers are offered: Yes, glossed as it must 
be true, given what you are told; No, it can't be true, given 
what you are told; and Maybe, it may be true or it may be 
false, you haven't been told enough to be certain whether it 
is Yes or No. 

In this format, the correct answer for all invalid 
principles is Maybe. A few, perhaps over-cautious 
respondents give this answer to virtually all questions, and 
so automatically tend to achieve mastery of invalid 
principles. A related quibble with the format is that one's 
immediate reaction to an invalid principle might be "no", 
meaning "not necessarily." It is difficult to check whether 
in fact this has had any serious impact on the results. The 
detailed item analyses given in the Appendices suggest that 
there may be some such effect since 1986 as the numbers 
giving the answer "No" to questions using invalid principles 
where the expected incorrect answer is "Yes" are much higher 
than those answering "Yes" where the expected incorrect 
answer is "No" (compare q3, q7, ql7 with ql2 and q20) . But 
on valid principles too there are often large numbers 
offering the unexpected wrony answer . 

As noted already, the 36 items are grouped into six 
principles of six items each. Table 3 lists the principles 
employed in the five tests and gives the formal structure for 
each principle . 
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Table 3: Principles Tested in Each Test 



1985 [Mona Test B (E) ] MODPON MODTOL HYPSYL DENCON AFFCON QAFCON 



1986 [Test C(E)] REL MODTOL MVAL 

1987/89 [Test C(E)2] MODPON MODTOL MVAL 



DENANT NUM 



DEN ANT NUM 



MINVAL 
MINVAL 



These "principles" consist of three valid and three invalid items each 
and are not identified in a purely formal manner* The other principles are 
formally as follows: 

MODPON - [valid] if p then q, p, so q 

MODTOL - [valid] if p then q, not q, so not p 

HYPSYL - [valid] all A are B, all B are C, so all A are C 

DENCON - [valid] all A are B, this is not B # so this is not A 

DENANT - [invalid] if p th en q, n o t p, so not q 

AFFCON - [invalid] if p then q, q, so p 

QAFCON - [invalid] all A are B, this is B, so this is A 

MVAL - [valid] most A are B, all B are C, so most A are C 

MINVAL - [invalid] most A are B, most B are C, so most A are C . 

The three valid REL items will be labelled RV; they are based on the 
transitivity of certain relations- The three invalid REL items will be 
labelled RI. Similarly the NUM items will be divided into MATHV (or MV) 
and MATHIN (or MI) . As noted later in the text, items in 1985 were also 
classified into symbolic (SYMBOL or SYM) and suggestive (SVG) groups. 



As should be obvious from the preceding, the items used 
to test a principle have been identified structurally (or 
semantically for the two deviant principles) . No suggestion 
is involved that any ordinary person would respond to such 
structure, although one might hope that a student of formal 
logic would do so- One could say that the items have been 
chosen normatively, from the perspective of formal logic, 
rather than with an eye to uncovering £he ways in which 
untutored people handle such problems. There is then no 
particular interest or importance in conventional measures of 
reliability for such tests; they indicate rather the extent 
to which people fail to utilize what might se<=>™ the most 
appropriate way of handling these problems- The Appendices 
contain relevant statistics for these tests, from which it 
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can be seen that the Cronbach alphas are just about 
respectable , though this is due more to the number of items 
(and in 1985 to the greater variance of the scale due to the 
many who left several questions unanswered) than to any 
uniformity in content, as the item to scale correlations 
suggest. It can also be seen that such correlations tend to 
improve as one proceeds through the test, which again is 
simply a reflection of the numbers failing to finish in good 
time . 

Each entrance examination paper also contains two other 
tests, one verbal (as a matter of fact, since 1986 this has 
involved a grasp of relations between pairs of items so is 
more than a test of vocabulary), the other usually of spatial 
ability , but in 1989 of simple applied mathematics. 
Candidates are told to spend half an hour on each of the 
three sections, but this does not always happen. The logic 
questions are in the third section of the paper, with the 
result that latecomers often omit most or all of them. For 
that reason, sample numbers are a little smaller than the 
number of actual entrants since persons failinc to answer 
more than a couple of questions in the logic test have been 
excluded. Control over examination conditions was worst in 
1985 - 47 entrants have been excluded and the item analyses 
reported in Appendix 1 show that well over 100 candidates 
failed to answer the last 15 questions; results will 
occasionally be given for 1985 based on a much smaller group 
of 452 who were deemed to have completed the test. But for 
those included in the sample, missing answers have been 
regarded as mistakes. 

The complete entrance examination comprises another two 
papers for all candidates except those for the College of the 
Bahamas. Paper 2 is an English language paper; paper 3 was a 
general education paper but now relates to the specific area 
the candidate wishes to pursue. These papers vary 
considerably fror\ year to year; results on paper 2 will be 
given to allow comparisons with the verbal test included in 
paper 1 . 



Results 

The most important result from these tests is the 
percentage mastery of each of the logical principles. Table 
4 gives the percentage of those who have mastered and are on 
the borderline for each principle in each test. The 
percentage of those lacking mastery is easily calculated. 

The stability of mastery percentages is noticeable, with 
1986 being a little better than the rest for valid 
principles. This stability might seem upset by the results 
for 1985 but when the smaller group of 452 "finishers" is 
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Table 4: Percentage Mastery and Borderline for Principles 



Mastery 
Borderline 



Mastery 
Borderline 



Mastery 
Borderline 



Mastery 
Borderline 



Mastery 
Borderline 



1985 (N - 622) 
MODPON MODTOL HYPSYL DENCON AFFCON 

55 36 2 



41 



21 



REL 



30 
28 



15 



67 
17 



68 



18 



27 



18 



49 

20 



20 



42 

21 



44 



22 



20 



24 



1986 (N = 472) 



MODTOL MVAL 



DEN ANT NUM 



60 
24 



5 
8 



MODPON MODTOL MVAL 
66 38 58 



22 



12 



1988 (N = 594) 



MODPON MODTOL MVAL 



57 
21 



4 

9 



1989 (N = 622) 



MODPON MODTOL MVAL 



57 



21 



35 
31 



1987 (N = 361) 

DEN ANT NUM* 
5 33 



24 



DENANT NUM 



27 
31 



DENANT NUM 



31 



24 



QAFCON (SYM SUG) 

5 7 9 

6 20 29 

MINVAL (RV RI MV MI) 
8 45 7 25 35 



8 



11 



13 



38 42 39 40 



MINVAL (MV MI) 
9 18 38 



39 37 



MINVAL (MV MI) 

9 17 34 

9 42 41 

MINVAL (MV MI) 



23 34 



32 37 



used that year falls into line (with, for instance, scores of 
53 and 25 for MODPON, and 37 and 23 for MODTOL). 

The relative difficulty of the principles also remains 
stable, and is consistent with Ennis* findings for the US. 
The valid principles are ordered HYPSYL, MODPON, MVAL, DENCON 
and MODTOL where principles using quantifiers are easier than 
their conditional analogues. This is also found with the 
invalid principles QAFCON and AFFCON while the quantifier 
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principle MINVAL is easier than DENANT though it has no 
obvious formal analogy with it. 

While the results are fairly stable and in accordance 
with expectations perhaps the most important point to be made 
about them is that they do not reflect a satisfactory level 
of elementary reasoning ability. They tell us that roughly 
40% of the entrants have not mastered MODTOL, which is a 
fundamental reasoning tool in our investigation of the world: 
a long tradition, stretching at least from Lord Bacon to its 
most notorious contemporary exponent, Sir Karl Popper, has 
seen in the falsification of predictions the most powerful 
means we have of revising our view of the world (cf. Brandon 
[3], ch. 3). When this is combined with the gross inability 
(characterizing roughly 80% of the entrants) to recognize 
invalid inferences (which is to say, a liability to think one 
is on safe ground when one isn't), one might be forgiven for 
refusing to place much confidence in the role of reason in 
the mental economy of these teachers. 

While mastery of formally invalid principles is extremely 
low (as it is in Ennis' US data too) it is worth noting that 
the respondents do considerably better with invalid items 
where the invalidity is more a matter of content (those items 
labelled RI and MI); indeed with the particular items 
selected here they do better on invalid items with a 
mathematical content than on valid ones. This may support 
attempts to excuse the performance on the formal principles 
by reference to contextual factors (cf. Brandon [1]) or in 
other ways, though whatever one says, the answers given by 
the vast majority are still wrong and reflect an inadequacy 
somewhere in their processing of the information given. 

It is possible to inquire whether there are any 
interesting variations among the entrants on logical 
competence. But as noted earlier, such investigations can 
only be regarded as provisional and suggestive, given the 
nature of the sample. Comments will be made about variations 
in deductive competence between students applying for 
different programmes, from different territories, and finally 
of different gender. 

Table 5 gives the mean and standard deviation of scores 
(with F values) on each principle and of various other 
variables for three groups of applicants distinguishable in 
terms of academic programme. Three groups are produced since 
Certificate applicants can be separated into those applying 
for the intramural programme at Mona and those applying to 
take the in-service programme offered on the UWI Distance 
Teaching Experiment's telephonic system. Anecdotal evidence 
suggested that these two groups might differ, as indeed table 
5 confirms. It may be added that the UWIDITE applicants 
include virtually all the non-Jamaican Certificate 
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applicants, though also a good proportion of Jamaican 
applicants as well. 



Table 5: Means, Standard Deviations and F test for Variables by Programme 

1085 







MODPON 


MODTOL 


HYPSYL 


DENCON 


AFFCON 


QAFCON 










B. Ed. 


mean 


3.75 


3.30 


4.27 


3.8 7 


1.31 


1.51 










N = 247 


s . d . 


1.72 


1.60 


1 4 6 


1 4 6 


i 1 f) 

t J U 


J. » "5 / 










Cert. 


mean 


3.86 


3.16 


4.39 


3.64 


1.14 


1.51 










N = 160 


3 » Cl * 


1.61 


1 . 6 1 


1.44 


1 3 6 


1 1 4 


j. • p 










DTE 


mean 


3.95 


3 .39 


4.43 


3.93 


1.34 


1.72 










N = 215 


S * d * 


1 .72 


1.62 


1.52 


1.46 


1 19 


1 5 5 












F 


0.77 


0.88 


0.77 


2.04 


1.43 


1.41 












p 


0.46 


0.41 


0.46 


0.13 


0.24 


0 2 4 














LOGTOT 


VERTOT 


SPATOT 




SYMBOL 


SUGG 










B.Ed. 


mean 


18.00 


4 2.25 


33.58 




2.51 


2.95 










N = 247 


s . d. 


6.48 


12.80 


16.12 




1.43 


1.34 










Cert. 


mean 


17.69 


40.83 


25,97 




2 4 9 


2 8 2 










N = 160 


s . d . 


5.80 


11.13 


13.71 




1.37 


1.28 










DTE 


mean 


18.76 


42.91 


30.61 




2 7 3 


3 0 4 










N = 215 


s.d. 


6.46 


12.58 


14.90 




1.42 


1 . 32 












F 


1.48 


1.34 


12.26 




1 73 


1 2 5 














0.23 


0.26 


0.00 




0.18 


0.29 


















1986 










































REL 


MODTOL 


MVAL 


DENANT 


NUM* 


MINVAL 




RV 




RI 


B.Ed . 


mean 


3.75 


4.35 


4.69 


1 .54 


3.81 


1.7 4 


2 


.30 


1 


.45 


N = 179 


s ,d. 


1.25 


1.40 


1 .25 


1.51 


1.37 


1.89 


0 


.79 


0 


.83 


Cert. 


mean 


3.15 


4.05 


4.43 


1.40 


3.69 


1 .54 


1 


.98 


1 


.18 


N = 124 


s.d. 


1.21 


1.49 


1 .25 


1.40 


1 .36 


1.71 


0 


.88 


0 


.76 


DTE 




A no 


a in 
*t * _i i. 


a n r 
•* • / b 


i . .' J 


4.UO 


1.4/ 


2 


. 4 1 


1 


. 59 


N = 169 


s . d . 


1.15 


1.55 


1 . 24 


1.56 


1 .25 


1 .58 


0 


.70 


0 


.80 




F 


18.15 


1 .78 


2.66 


1.7 8 


3.42 


1 .12 


11 


.14 


9 


.40 






0.00 


0.17 


0.07 


0.17 


0.03 


0.3 3 


0 


.00 


0 


.00 
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MATHV MATH IN LOGTOT SPATOT VERTOT PAPER2 

B.Ed. mean 1.74 2.07 19.88 21.66 29.49 28.68 

N = 179 s.d. 0.85 0.95 4.91 8.23 8.52 13.54 

Cert. mean 1.73 1.96 18.27 18.36 25.86 24.19 

N * 124 s.d. 0.87 0.90 4.42 6.63 8.31 9.94 

DTE mean 2.03 2.05 20.15 22.19 30.37 27.42 

N * 169 s.d. 0.82 0.83 4.47 8.01 8.55 12.39 



F 
£ 



6.54 
0.00 



0.59 
0.55 



6.57 
0.00 



9.75 
0.00 



10.87 
0.00 



5.00 
0.01 



1987 



MODPON MODTOL MVAL 



DENANT NUM 



MINVAL 



B.Ed. mean 4.72 3.86 4.62 1.75 3.68 1.69 

N = 224 s.d. 1.32 1.55 1.21 1.64 1.28 1.78 

Cert. mean 4.49 3.51 4.28 1.41 3.46 1.83 

N = 76 s.d. 1.60 1.61 1.44 1.33 1.57 1.58 

DTE mean 4.77 3.67 4.51 1.74 4.00 1.80 

N = 61 s.d. 1.54 1.79 1.34 1.50 1.46 1.97 



F 
£ 



0.92 
0.40 



1.42 
0.24 



1.98 
0.14 



1.39 
0.25 



2.58 
0.08 



0.23 
0.79 



MATHV 



MATH1N LOGTOT SPATOT VERTOT PAPER2 



B.Ed. mean 1.59 2.09 20.32 21.43 27.40 6.81 

N = 224 s.d. 0.92 0.90 4.11 8.13 7.65 5.59 

Cert. mean 1.47 1.99 18.97 20.78 22.20 5.63 

N - 76 s.d. 0.87 0.98 5.00 7.42 6.86 4.99 



DTE 
N = 61 



mean 
s.d. 



1.98 
0.91 



2.02 
0.95 



20.49 
5.06 



20. 80 
8.96 



27.57 
7.81 



7 
6 



74 
13 



F 
£ 



5.91 
0.00 



0.41 

0.66 



2.86 
0.06 



0.26 
0.77 



14.46 
0.00 



2.48 
0.09 




12 



J3 



1988 



B.Ed. mean 
N = 389 s.d. 

Cert. mean 
N = 117 s.d. 

DTE mean 
N - 87 s.d. 

F 
£ 



B.Ed. mean 
N = 389 s.d. 

Cert. mean 
N = 117 s.d. 

DTE mean 
N = 87 s.d. 

F 
£ 



B.Ed. mean 
N = 385 s.d. 

Cert. mean 
N = 107 s.d. 

DTE mean 
N « 130 s.d. 



F 



MODPON 

4.84 
1.25 

4.63 
1.37 

4.86 
1.31 

1.31 
0.27 

MATHV 

1.60 
0.89 

1.64 
0.G6 

1.85 
0.85 

2.91 
0.06 



MODPON 

4.91 
1.20 

4.58 
1.36 

5.02 
1.29 



4.00 
0.02 



MODTOL 

3.97 
1.54 

3.83 
1.61 

4.00 
1.65 

0.42 
0.67 

MATHIN 

1.97 
0.95 

2.04 
0.S3 

2.00 
0.91 

0.27 
0.76 



MODTOL 

3.96 
1.59 

3.94 
1.60 

4.18 
1.56 



1.03 
0.36 



MVAL 

4.52 
1.26 

4.34 
1.42 

4.41 
1.49 

0.95 
0.39 

LOGTOT 

20.18 
4.44 

19.54 
4.59 

20.66 
5.42 

1.53 
0.22 



4.50 
1.29 

4.34 
1.37 

4.65 
1.31 



1.64 
0.19 



DENANT 

1.60 
1.54 

1.24 
1.33 

1.63 
1.58 

2.87 
0.06 

SPATOT 

19.42 
7.29 

18.30 
5.67 

21.46 
8.41 

4.89 
0.01 



1.63 
1.62 

1.47 
1.61 

1.46 
1.5 



0.78 
0.46 



NUM 

3.57 
1.37 

3.69 
1.31 

3.85 
1.43 

1.59 
0.21 

VERTOT 

28.67 
8.19 

26.30 
8.23 

29.41 
9.67 

4.44 
0.01 



NUM 

3.71 
1.43 

3.33 
1.37 

3.64 
1.50 



2.93 
0.05 



MINVAL 

1.68 
1.71 

1.82 
1.74 

1.90 
1.70 



0.76 
0.47 

PAPER2 

10.52 
5.81 

9.86 
6.40 

12.91 
6.24 

7.09 
0 . 0 0 



MINVAL 

2.03 
1.93 

1.66 
1.65 

1.71 
1.80 



2.50 
0.08 



1989 
MVAL DENANT 
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MATHV 


MATH IN 


LOGTOT 


MATHOT 


VERTOT 


PAPER2 


B.Ed. 


mean 


1.68 


2 .03 


20.76 


15.50 


29.90 


35.70 


N = 385 


s .d. 


0.93 


0.96 


4.91 


5.06 


8.57 


10.92 


Cert. 


mean 


1.55 


1.78 


19.32 


14.57 


30.01 


33.49 


N = 107 


s.d. 


1.03 


0.95 


4.73 


4.66 


8.92 


12.29 


DTE 


mean 


1.78 


1.85 


20.65 


15.70 


30.72 


35.90 


N = 130 


s.d. 


0.95 


0.95 


5.39 


5.33 


9.62 


12.10 




F 


1.76 


3.79 


3.56 


1.74 


0.42 


1 .74 




E 


0.17 


0.02 


0.03 


0.18 


0.66 


0.18 



The general picture given by table 5 is that the B.Ed, 
mean score lies somewhere between that for the Mona 
Certificate and the UWIDITE Certificate applicants. In most 
cases the actual differences are insignificant (though no 
test has been done on the persistent ranking of the three 
groups) and the larger differences are mostly localized to 
non-formal logical matters (RV, RI, and MATHV in 1986; MATHV 
in 1987 and almost in 1988; and MATH IN in 1989) or other 
variables (spatial ability in 1985, 1986, and 1988; verbal in 
1986, 1987, and 1988 and the related English paper 2 in 1986 
and 1988). The low scores of Mona Certificate applicants in 
these areas could reflect their provenance predominantly in 
the Jamaican primary sector, whereas the other two programmes 
recruit a good number from outside J*r.<aica and/or the non- 
primary sector. 

Only in the 1989 test was a difference significant at 
0.05 found in any of the purely formal logical principles 
(MODPON) and this appears to have helped the overall logic 
total to show a significant difference too (though with the 
B.Ed, mean marginally above the UWIDITE). But with the 
number of tests reported in table 5 this does not seem 
particularly important. 

It has been suggested that the small but persistent 
differences found in the two Certificate groups may be 
related to the territorial origin of u .he applicants. Because 
numbers of non-Jamaicans are always very small the data have 
not been reported by territory, but the 1987 entrants have 
been divided a priori (that is to say, on the basis of 
impressionistic evidence rather than an examination of actual 
mean scores for the territories) into two groups, one 
comprising those from Jamaica, the Bahamas, Dominica, and 
Grenada, the other comprising the rest. This very crude 
division produced significant differences on the overall 
logic total (p_ = 0.03), the principles DEN ANT (p_ = 0.03) and 
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MATHV (£ - 0.00), and both the verbal test (£ - 0.00) and the 
English paper 2 (p = 0.00). A three-way AN OVA (adding sex as 
veil) on the verbal test (which had shown significant 
differences by academic programme) gave an F for programme of 
15.49 (£ = 0.00); for territory of 12 46 (p_ = 0.00); and for 
sex of 2.49 (£ = 0.12). The biggest difference (on paper 2 
where the mainly Jamaican group's mean was 6.16 (s.d. = 5.05) 
as against 10.54 (s.d. = 7.42) for the others) showed a 
significant sex/programme interaction (F = 4.23, £ = 0.02) 
but only territory among the main effects, (F * 24.75, £ = 
0.00). These findings would suggest, if they can be used as 
a basis for generalization, that while territorial 
differences are playing a role, there are genuine differences 
also among the programmes in at least some variables. 

While not reported here in detail, territorial means were 
also calculated for 1988 and 1989; they showed as above 
larger differences on the non-logical variables: in 1988, the 
verbal test mean ranged from 21.00 to 38.33; spatial from 
15.75 to 30.00; paper 2 from 8.50 to 21.67, while the logic 
total ranged only from 17.33 to 28.00, valid items from 13.50 
to 17.67, and invalid items from 3.83 to 10.33. In 1989 the 
verbal test ranged from 24.81 to 35.00; maths from 11.67 to 
17.14; paper 2 from 32.19 to 47.80; logic total from 18.11 to 
24.22, valid items from 13.25 to 17.64, and invalid items 
from 4.C7 to 7.25. 

Finally, and possibly most contentiously , it is possible 
to group respondents with respect to gender,. Table 6 reports 
means, standard deviations, and T values for the various 
variables grouped by gender (male coded 1, female 2). As 
noted earlier, there is little likelihood that the gender 
sampling is as representative as the overall sampling of non- 
graduate teachers; males are mostly applying for 
administration, or certain secondary subject specialisms, and 
this reflects their original position within the school 
system. 

Table 6: Means, Standard Deviations and T-test for Variables by Sex 

1985 (N male = 124; female = 496) 







MODPON 


MODTOL 


HYPSYL 


DENCON 


AFFCON 


QAFCON 


Male 


mean 


3.66 


3.18 


4.15 


3.77 


1.40 


1.67 




s.d. 


1.67 


1.48 


1.60 


1.42 


1.34 


1.48 


Female 


mean 


3.90 


3.33 


4.41 


3.85 


1.25 


1.56 




s.d. 


1.70 


1.64 


1.44 


1.44 


1.20 


1.46 




T (618) 


-1.41 


-0.92 


-1.71 


-0.50 


1.24 


0.74 






0.16 


0.36 


0.09 


0.62 


0.21 


0.46 
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LOGTOT 

Male mean 17.84 

s.d. 6.60 

Female mean 18.29 

s.d. 6.24 

T (618) -0.72 

£ 0.47 



VERTOT SPATOT 

43.04 32.73 

11.00 16.85 

41.86 29.99 

12.66 14.93 

0.95 1.78 

0.34 0.08 



SYMBOL SUGG 

2.62 2.84 

1.45 1.30 

2.57 2.98 

1.41 1.32 

0.34 -1.07 

0.73 0.29 









1986 (N 


male = 


115; female = 356) 












* 

REL 


MODTOL 


MVAL 


DENANT 


NUM* 


MINVAL 


RV 


RI 


Male 


mean 
s.d. 


4.13 
1.12 


4.23 
1.55 


4.83 
1.11 


1.93 
1.69 


4.17 
1.35 


1.76 
1.93 


2.57 
0.61 


1.57 
0.81 


Female 


mean 
s.d. 


3.54 
1.25 


4.17 
1.46 


4.60 
1.28 


1.46 
1.42 


3.79 
1.31 


1.54 
1.67 


2.15 
0.83 


1.38 
0.82 




T (469) 


4.51 
0.00 


0.38 
0.70 


1.70 
0.09 


2.95 
0.00 


2.73 
0.01 


1.18 
0.24 


4.90 
0.00 


2.05 
0.04 



Male mean 
s.d. 

Female mer.n 
s.d. 

T (469) 



MATHV MATH IN 

2.06 2.11 

0.84 0.89 

1.78 2.01 

0.85 0.89 

3.14 1.06 

0.00 0.29 



LOGTOT SPATOT 

21.05 23.16 

4.97 8.97 

19.09 20.27 

4.49 7.42 

3.96 3.44 

0.00 0.00 



VERTOT PAPER2 

30.82 27.14 

8.46 12.95 

28.22 27.08 

8.66 12.17 

2.80 0.04 

0.01 0.97 



1987 (N male = 75; female = 286) 
MODPON MODTOL MVAL DENANT NUM* MINVAL 



Male 


mean 


4. 


64 


3. 


47 


4 


.48 


1 


.93 


3. 


95 


1 


.95 




s.d. 


1 # 


35 


1. 


66 


1 


.23 


1 


.56 


1. 


48 


1 


.81 


Female 


mean 


4. 


69 


3. 


83 


4 


.54 


1 


.60 


3. 


62 


1 


.68 




s.d. 


1. 


44 


1. 


59 


1 


.31 


1 


.55 


1. 


36 


1 


.76 




T (359) 


-0. 


28 


-1. 


75 


-0 


.35 


1 


.62 


1. 


80 


1 


.15 






0. 


78 


0. 


08 


0 


.73 


0 


.11 


0. 


07 


0 


.25 
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MATHV MATH IN LOGTOT SPATOT VERTOT PAPER2 



Male 


mean 
s . d. 


1.73 
0.93 


2.21 
1.04 


20.41 
4.73 


24.07 
9.55 


27.59 
8.21 


6.83 
5.03 


Female 


mean 

S.d. 


1.61 
0.92 


2.01 
0.89 


19.97 
4.45 


20.43 
7.55 


26.01 
7 .68 


6.69 
5.75 




T (359) 

£ 


1.05 
0.30 


1.67 
0.10 


0.75 
0.45 


3.49 
0.00 


1 .56 
0.12 


0.18 
0.85 








1988 (N 


male = 116; female 


: - 478) 








MODPON 


MODTOL 


MVAL 


DENANT 


NUM 


MINVAL 


Male 


mean 
s . d . 


4.52 
1 • 4 5 


3.52 
1.63 


4.48 
1.39 


1.98 
1.61 


3.88 
1.23 


1.87 
1.87 


Female 


mean 
s.d. 


4.87 
1.24 


4.05 
1.54 


4.47 
1.31 


1.43 
1.47 


3.58 
1.40 


1.71 
1.68 




T (592) 


-2.64 
0.01 


-3.33 
0.00 


0.12 
0.91 


3.58 
0.00 


2.15 
0.03 


0.93 
0.35 






MATHV 


MATHIN 


LOGTOT 


SPATOT 


VERTOT 


PAPER2 


Male 


mean 
s.d. 


1.84 
0.88 


2.03 
0.86 


20.25 
5.37 


21.77 
8.29 


29.03 
8.47 


11.50 
6.08 


Female 


mean 
s.d. 


1.60 
0.88 


1.98 
0.94 


20.09 
4.44 


18.95 
6.85 


28.13 
8.49 


10.55 
6 .05 




T (592) 


2.74 
0.01 


0.58 
0.56 


0.33 
0.74 


3.81 
0.00 


1.02 
0.31 


1.51 
0.13 








1989 (N 


male = 115; female 


= 507) 








MODPON 


MODTOL 


MVAL 


DENANT 


* 

NUM 


MINVAL 


Male 


mean 
s.d. 


4.82 
1.32 


3.95 
1.69 


4.43 
1.45 


1.84 
1.73 


4.00 
1.58 


2.21 
1.96 


Female 


mean 
s.d. 


4.89 
1.24 


4.02 
1.56 


4.52 
1.28 


1.51 
1.57 


3.55 
1.40 


1.83 
1.84 




T (620) 
E 


-0.59 
0.56 


-0.43 
0.67 


-0.64 
0.53 


2.04 
0.04 


3.06 
0.00 


1.97 
0.05 
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MATHV 



MATH IN MATHOT LOGTOT VERTOT PAPER2 



Male 


mean 


1. 


97 


2. 


03 


18. 


90 


21 


.25 


32. 


04 


36. 


87 




s.d. 


0. 


98 


1. 


01 


5. 


14 


5 


.91 


8. 


15 


11. 


71 


Female 


mean 


1. 


61 


1. 


93 


14. 


58 


20 


.31 


29. 


65 


35. 


01 




s.d. 


0. 


94 


0. 


95 


4. 


70 


4 


.77 


8. 


97 


11. 


40 




T (620) 


3. 


70 


0. 


94 


8. 


73 


1 


.82 


2. 


63 


1. 


57 






0. 


00 


0. 


35 


0. 


00 


0 


.07 


0. 


01 


0. 


12 



As far as the purely logical principles go, table 6 
reveals virtually no significant differences, except that 
DEN ANT goes to the men on three occasions, while the usual 
female superiority on MODPON and MODTOL is significant in one 
year. There are, however, several occasions when the male 
average is significantly higher on the content-based 
"principles", REL (both RV and RI) and MATHV, on the spatial 
and mathematical tests, and on the English paper 2. This 
superiority in English and mathematical tests probably 
reflects the skewing of the male sample towards higher status 
parts of the school system. 

Grouping together valid and invalid items allows one a 
simple view of the very great difference in competence which 
has been found in all such investigations. Table 7 reports 
means and standard deviations for valid and invalid items by 
sex, with T values, allowing a fairly strong test of the 
suggestion made in Nolan and Brandon [10] that there might be 
a slight gender-related difference here. As can be seen, the 
evidence of these data does give prima facie support for such 
a difference. In only one year is there a significant 
difference on valid items and the slight advantage varies 
between male and female from year to year, but in four out of 
five years there is a significant difference on the invalid 
items where the male group consistently scores higher. But 
what in fact does this prove? Table 4 shows conclusively 
that neither gender comes anywhere near general mastery of 
invalid principles; it could be argued that table 7 simply 
displays a slightly greater tendency to hedge one's bets (by 
answering "MAYBE"), which could be a consequence of slightly 
higher status and the self-confidence it gives. 
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Table 7: Means and Standard Deviations for Valid/ Invalid Items by Sex 

Valia Invalid 
Male Female Male Female 

1985 mean 14.77 15.48 3.07 2.81 
s.d. 5.21 5.18 2.48 2.30 
T (618) -1.38 1.11 

£ 0.17 0.27 

1986 mean 13.69 12.70 7.37 6.39 
s.d. 2.71 2.97 3.55 2.84 
T (469) 3.17 3.02 

£ 0.00 0.00 

1987 mean 14.32 14.67 6.09 5.30 
s.d. 3.67 3.81 3.11 2.64 
T (359) -0.71 2.22 

£ 0.48 0.03 

1988 mean 14.36 14.98 5.89 5.11 
s.d. 3.97 3.47 2.97 2.76 
T (592) -1.68 2.68 

2 0.09 0.01 

1989 mean 15.17 15.05 6.08 5.27 
s.d. 4.24 3.64 3.22 2.95 
T (620) 0.31 2.61 

£ 0.76 0.01 



Besides inquiring about differences among the candidates , 
one can also ask about differences among the items in the 
tests. Ennis had attempted to gauge the importance of 
various content factors on competence in deductive reasoning. 
He had distinguished items with symbolic content (schematic 
letters replacing nouns) , items with what he called 
suggestive content (typically arguments with absurd claims in 
which the conclusion is patently false) , and items with 
ordinary unexceptionable content. The 1985 logic test 
retained his types of item (with the rest classified as 
ordinary ) ; it revealed, as expected from Ennis' own work, 
that these kinds of content do not appear to make much 
difference overall, although symbolic itemf do seem somewhat 
more difficult (see table 8) and are more often omitted (see 
Appendix 1 in particular) . Anecdotal evidence from teaching 
formal logic suggests that the kind of symbolism also makes a 
difference. In the entrance examination logic tests, nouns 
are replaced by schematic letters (so one might be told that 
there is an X ) but in another investigation one of the items 
for the principle MODPON involved the replacement of whole 
sentences (or clauses) with schematic letters (e.g. if p then 
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Table 8: Percentage Mastery and F test on Kinds of Content (1985, N = 452) 

SYMBOL SUGGESTIVE ORDINARY 

Mastery 9 12 15 

Borderline 24 38 38 

Mean 2.93 3.36 3.62 

Standard Deviation 1.26 1.17 0.83 



<j) as is done in formal logic. As expected, this item proved 
much more difficult than the noun replacement equivalent, as 
shown in table 9. 

Table 9: Difficulty and Discrimination Indices for Symbolic 
Items among two samples 

St Lucia Trainees Jamaica Grade 10 
Diff. Disc. Diff. Disc. 

Noun variable .91 .13 .87 .41 

Sentence variable .53 .13 .48 .35 

Note: The argument principle is MODPON, in one case phrased 
as A£ there is an X, there is a Y, etc. in the other _if p_ 
then <j, etc. The difficulty index is as usual really a 
facility index - 91% of the trainees got the name variable 
question right. Unpublished data. 

While in general types of content do not play a very 
important part, the specific content of individual items may 
well make a big difference to performance. This possibility 
is consistent with the suggestion that people in general do 
not attend to, or at least directly base their judgment upon 
an informed awareness of, the formal structure of an argument 
or inference when they evaluate it. In any case, the 
difficulty (or better facility) and discrimination indices 
for the individual items reveal considerable variation within 
each formally identical principle, as can be seen from the 
appendices. The difficulty index is the mean right score for 
the item; the discrimination index used is the difficulty in 
the bottom 27% subtracted from the difficulty in the top 27% 
of the sample. In most years the most consistent set of 
items is MINVAL, where there are no distractions provided by 
logically superfluous and unexpected negations in any of the 
items . 
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The 1985 test was structured to examine the relationship 
between items expressed using conditionals and virtually 
identical items expressed with quantifiers. In modern formal 
logic the quantified expressions are in fact seen as 
containing conditionals, so all A are B is construed as for 
all x, if x is A then x is B . The questions testing MODTOL 
were paired with those for DENCON while three of those for 
AFFCON were paired with QAFCON. Table 10 gives mean scores 
and inter-item correlations on these sets of items. While 
the inter-item correlations are not particularly impressive, 
they are higher than such correlations between unpaired 
items, even within the same principle: the virtual identity 
of content seems to be playing a role, whereas the structural 
parallels exploited by the theory of modern logic do not seem 
to impinge. 



Table 10: Mean scores and inter-item correlations on paired items 
MODTOL DENCON corr AFFCON QAFCON corr 





mean 




mean 






mean 




mean 




q2 


.83 


q35 


.64 


.16 


qs 


.30 


qll 


.42 


.37 


qlO 


.43 


q26 


.37 


.31 




.15 


q33 


.12 


.17 


ql7 


.44 


q20 


.48 


.26 


q22 


.12 


ql5 


.20 


.12 


q23 


.51 


ql4 


.65 


.36 










q28 


.60 


q7 


.90 


.12 












q32 


.46 


q4 


.76 


.20 













When responses are classified by reference to the correct 
answer and to the formal principle involved, performance 
seems to involve a number of components. We have already 
noted the probable importance of the specific content; 
correlations between the formally identifed principles 
usually show a strong linkage between valid principles and a 
weaker one between invalid principles but very little across 
that divide (though DENANT is often negatively correlated 
with valid conditional principles) . In those tests in which 
numeric arguments were used, these items generally stood out 
on their own as well* 

To try to obtain a rough picture of what might be behind 
the data, exploratory factor analysis of the correlations 
between the logical principles, other variables, and sex (as 
a further check on the role of gender in reasoning ability) 
was attempted* Table 11 gives for each year the correlation 
matrix and a varimax rotated factor analysis for each matrix, 
using estimated communalities on the diagonal and including 
factors with an eigenvalue of at least 1 or factors 
explaining a substantial amount of the variance. 



Table 11: Correlation Matrices and Factor Analyses for 
each sample for logical principles, other tests, and sex 



1985 

(a) Correlation matrix 



mc Ip 


modt 


hyps 


dene 


af f 


qaf 


ltot 


stot 


vtot 


sex . t7 


.05 


.07 


.03 


-.03 


-.02 


.04 


-.09 


-.04 


modpon 


.58 


.63 


.57 


.12 


.25 


.78 


.14 


.18 


modtol 




.54 


.66 


.18 


.27 


.79 


.21 


.24 


hypsyl 






.58 


.22 


.27 


.78 


.17 


.26 


dencon 








.18 


.27 


.78 


.19 


.24 


af fcon 










.51 


.48 


.10 


.13 


qafcon 












.59 


.21 


.26 


logtot 














.24 


.31 


spatot 
















.39 


vertot 
















1.00 



(b) Varimax rotated factor analysis (2 factors, eigenvalues 2.74 and 0.68 
explaining 72.0% and 17.8% of variance respectively) of (a) omitting logtot 





Factor 1 


Factor 


2 












sex 


.10 




-.11 














modpon 


.75 * 




.13 














modtol 


.73 * 




.22 














hypsyl 


.71 * 




.23 














dencon 


.74 * 




.21 














af fcon 


.09 




.53 


* 












qafcon 


.19 




.61 














spatot 


.15 




.38 


* 












vertot 


.21 




.41 


* 
















1986 
















(a) Correlation matrix 




















pap2 rv ri 


modt mval 


den 


minv 


ITiV 


mi 


ltot 


stot 


vtot 


sex .01 -.22 -.10 


-.01 -.06 


-.12 


* 


05 


-.12 


-.04 


-.16 


-.16 


-.12 


paper2 .11 .07 


.13 .22 


.06 


• 


03 


.07 


.12 


.17 


.17 


.35 


rv .18 


.25 .35 


.15 


• 


07 


.19 


.13 


.51 


.26 


.32 


ri 


.20 .18 


.08 




08 


.12 


.16 


.43 


.17 


.18 


modtol 


.35 


-.18 




04 


.10 


.24 


.51 


.16 


.27 


mval 




.06 


• 


03 


.19 


.30 


.59 


.25 


.36 


denant 






• 


18 


.14 


.11 


.43 


.13 


.19 


minval 










.10 


.21 


. 5 3 


.15 


.08 


mathv 












.16 


.43 


.18 


.28 


mathin 














.54 


.11 


.24 


logtot 
















.34 


.45 


spatot 


















.42 


vertot 


















1.00 
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(b) Varimax rotated factor analysis (2 factors, eigenvalues 2.12 and 0.53 
explaining 66.0% and 16.6% of variance respectively) of (a) omitting logtot 





Factor 


1 


Factor 


2 


sex 


- . 09 




-.29 




paper2 


. 3 5 


* 


.06 




rv 


. 43 


* 


.28 




ri 


. 30 


* 


. 1 5 




mod to 1 


.56 


* 


-.14 




mval 


.60 


* 


.09 




denant 


.01 




.48 


* 


minval 


.06 




.30 




mathv 


.26 




.29 




mathin 


.37 


* 


.15 




spatot 


.57 


* 


.33 


* 


vertot 


.37 


* 


.15 





1987 

(a) Correlation matrix 



pap2 


modp 


modt 


mval 


den 


minv 


mv 


mi 


ltot 


stot 


vtot 


sex -.01 


.15 


.09 


.02 


-.09 


-.06 


-.06 


-.09 


-.04 


-.18 


-.08 


paper 2 


.25 


.27 


.25 


.11 


-.02 


.13 


.14 


.33 


.09 


.45 


modpon 




.56 


.43 


-.25 


-.06 


.10 


.19 


.59 


.12 


.27 


mod to 1 






.52 


-.22 


-.05 


.05 


.23 


.64 


.13 


.32 


mval 








-.01 


-.22 


.20 


.19 


.60 


.22 


.33 


denant 










. 04 


.15 


.15 


.26 


.15 


.16 


minval 












-.00 


.16 


.34 


-.09 


-.01 


mathv 














.13 


.39 


.15 


.30 


mathin 
















.54 


.12 


.24 


logtot 


















. 22 


.46 


spatot 




















.37 


vertot 




















1.00 



(b) Varimax rotated factor analysis (2 factors, eigenvalues 2.16 and 0.89 
explaining 59.4% and 24.4% of variance respectively) of (a) omitting logtot 





Factor 


1 


Factor 




sex 


-.19 




.15 




paper2 


.44 


* 


.22 




modpon 


.22 




.65 


* 


modtol 


.25 




.71 


* 


mval 


.39 




r -> 


* 


denant 


. 36 


* 


-.38 




minval 


. 01 




-.15 




mathv 


. 38 


* 


-.00 




mathin 


.36 


* 


.11 




spatot 


. 44 


* 


.03 




vertot 


.68 




.20 
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1988 



(a) Correlation matrix 



pap2 


modp 


modt 


mval 


den 


minv 


mv 


mi 


ltot 


s tot 


vtot 


sex -.06 


.11 


.13 


-.00 


-.15 


-.04 


-.11 


-.02 


- . 01 


- 15 


- 04 


paper2 


.13 


.12 


.17 


.11 


.05 


.18 


.13 


.24 


. 1 1 


. 3 0 


modpon 




.49 


.36 


-.17 


-.02 


.11 


.22 


.55 


.10 


.24 


modtol 






.46 


-.16 


.01 


.10 


.30 


.64 


.18 


.32 


mval 








.04 


-.16 


.20 


.23 


.58 


.18 


.32 


denant 










.15 


.18 


.19 


.37 


.12 


.10 


minval 












.04 


.17 


.41 


.08 


.06 


mathv 














.16 


.42 


.18 


.24 


mathin 
















.58 


.10 


.24 


logtot 


















.27 


.41 


spatot 




















.37 


vertot 




















1.00 



(b) Varimax rotated factor analysis (2 factors, eigenvalues 1.93 and 0.85 
explaining 59.3% and 26.1% of variance respectively) of (a) omitting logtot 





Factor 


1 


Factor 


2 


sex 


.03 




-.03 




paper2 


.30 


* 


.23 




modpon 


.57 


* 


-.24 




modtol 


.68 




-.24 




mval 


.61 


* 


-.05 




denant 


.00 




.50 


* 


minval 


.01 




. 25 




mathv 


.29 




.30 


* 


mathin 


.40 


* 


.19 




spatot 


.33 


* 


.29 




vertot 


.55 


* 


.26 





1989 

(a) Correlation matrix 



pap2 


modp 


modt 


mval 


den 


minv 


mv 


mi 


ltot 


mtot 


vtot 


sex -.0 6 


.02 


.02 


.03 


-.08 


-.08 


-.15 


-.04 


-.07 


-.33 


-.10 


paper2 


.26 


.26 


.32 


.12 


-.01 


.15 


.20 


.33 


.32 


.48 


modpon 




.51 


.46 


-.10 


.03 


.22 


.26 


.60 


.28 


.31 


modtol 






.50 


-.17 


.00 


.20 


.27 


.61 


.31 


.31 


mval 








A -7 
. V 1 


-.07 


.24 


. £. 1 


.63 


. 3 3 


.34 


denant 










.13 


.12 


.18 


.37 


.24 


.20 


minval 












.09 


.21 


-46 


.16 


.06 


mathv 














.14 


.47 


.42 


.32 


mathin 
















.58 


.27 


.28 


logtot 


















.52 


.47 


mathot 




















.50 
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(b) Varimax rotated factor analysis (2 factors, eigenvalues 2.65 and 0.85 
explaining 64.8% and 20.8% of variance respectively) of (a) omitting logtot 



Factor 1 



Factor 2 



sex 



-.02 



-.35 * 



paper2 
modpon 
modtol 
mval 



.46 * 

.65 * 

.70 * 

.67 * 
-.02 



.23 
-.09 
-.14 
-.00 



denant 

minval 

mathv 

mathin 

mathot 

vertot 



-.01 



.35 * 

.38 * 

.49 * 

.55 * 



.47 * 
.26 

.32 * 
.22 

.55 * 

.40 * 



Starting with the raw correlations, it is clearly seen 
that the logic, spatial and verbal totals are always highly 
correlated, and that the close connection between logical 
ability and language use more generally is also revealed by 
the correlations with Paper 2. Interestingly, the invalid 
plurative principle MINVAL is consistently uncorrelated with 
verbal or language ability. 

The usual result of the factor analyses is to produce one 
factor loading heavily on the formally valid principles, and 
usually also on the verbal and spatial tests, while the 
second factor loads on DENANT, MATHV, and to a lesser extent 
MINVAL and other variables. The 1987 factor pattern is 
unusual in having the valid item factor come second. In most 
cases the non-formal logic principles and the other parts of 
the test (verbal and spatial or mathematical) load reasonably 
highly on both factors; sex is usually not featuring on 
either factor though it gets a hold on the invalid factor in 
1986 and 1989. 



Conclusion 

The main pedagogical interest of these data has already 
been expressed: performance on everyday reasoning tasks is 
grossly inadequate. It is bad wherever it is tested, but the 
standards revealed in table 4 are generally lower than Ennis* 
results from US secondary schools. The little evidence that 
exists (summarized in Brandon and Sirbratthie [4]) suggests 
that this disadvantage is not confined to the test format 
employed here, but extends also to more discursive tests of 
aspects of critical thinking. Pedagogically , it is not of 
the greatest urgency to explore the factorial structure of 
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actual performance (though this might help in suggesting 
remedies) ; what matters is to find ways to improve that 
performance . This may well, as it usually does elsewhere, 
involve the teaching of new techniques, new ways of handling 
the information given. 

This paper is not, however, intended to argue for or to 
suggest such remedial action. Its point is simply to record 
the situation with respect to a few aspects of logical 
reasoning as it is in many Caribbean schools at present. 
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Footnotes 



1. Thus, to take but one example, if it were required 
that mastery of the valid principle to be labelled MODTOL 
were to involve recognizing also that the structurally 
similar principle DEN ANT is invalid, the percentage mastery 
in 1989 would drop from 44% to 2.3%; with the easier 
principle MODPON there would be a drop from 6 9% to 4%. 

2. See Norris [11] for some careful discussion of the 
problems involved in characterizing the processes actually 
used by people in performing reasoning tasks, Johnson-Laird 
[8] for a stimulating psychological review that argues 
against the use of logical principles or rules, and Brandon 
[2] for a few comments on this matter in the context of the 
present investgiation. 
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Appendices: Item Analyses 



Note: The figure given in the Diff(iculty) column for each principle is 
the average difficulty for the items included in the principle. 

Where appropriate, suggestive items are labelled as follows: ql2!; 
while symbolic items are labelled with an "x" , as q24x. 



Appendix 1 
Item analysis 1985 



Y N M Omit Correct Diff Disc Item s.d. Item/scale corr. 



modpon 












.64 








q3 


346 


18 


239 


19 


Y 


.55 


.18 


.49 


.17 


ql21 


473 


85 


37 


27 


Y 


.76 


.35 


.42 


.36 


ql6 


66 


417 


82 


57 


N 


.67 


. 52 


.47 


.46 


q24x 


466 


12 


31 


113 


Y 


.74 


.66 


.43 


.62 


q29 


365 


21 


96 


140 


Y 


.58 


. 70 


.49 


.57 


q36 


326 


13 


96 


187 


Y 


.52 


.76 


.49 


.59 


modtol 












.55 








q2 


19 


520 


67 


16 


N 


.83 


.22 


.37 


.26 


qlO 


118 


273 


116 


115 


N 


.43 


.34 


.49 


.29 


ql7x 


117 


274 


68 


163 


N 


.44 


.50 


.49 


.41 


q23 


318 


98 


87 


119 


Y 


.51 


.59 


.49 


.47 


q28 


23 


374 


59 


166 


N 


.60 


.79 


.48 


.61 


q32! 


96 


290 


41 


195 


N 


.46 


. 74 


.49 


.55 


hypsyl 












.72 








qi 


532 


34 


48 


8 


Y 


.85 


.18 


.35 


.23 


q8 


534 


17 


49 


22 


Y 


.85 


.20 


.34 


.27 


ql3x 


359 


144 


55 


46 


Y 


.57 


.44 


.49 


• 35 


q2i 


502 


8 


33 


79 


Y 


.80 


.48 


.39 


.53 


q25! 


419 


68 


30 


105 


Y 


.67 


.66 


.46 


.58 


q34 


363 


26 


50 


183 


Y 


.58 


.77 


.49 


.61 


dencon 












.63 








q4! 


61 


476 


53 


32 


N 


.76 


.32 


.42 


.28 


q7 


21 


561 


32 


8 


N 


.90 


. 15 


.29 


.23 


ql4 


409 


112 


55 


46 


Y 


.65 


.47 


.47 


.41 


q20x 


58 


301 


89 


174 


N 


.48 


.50 


.49 


• 42 


q26 


139 


231 


76 


176 


N 


.37 


.53 


.48 


.41 


q35 


16 


404 


17 


185 


N 


.64 


.86 


.47 


.68 


af fcon 












.20 








q5 


364 


34 


190 


34 


M 


.30 


m 29 


.46 


.24 


q9I 


380 


102 


96 


44 


M 


.15 


.16 


.36 


.20 


ql8 


118 


355 


87 


62 


M 


.13 


.14 


.34 


• . J 


q22x 


377 


30 


76 


139 


M 


.12 


.14 


.32 


.20 


q27 


193 


44 


251 


134 


M 


.40 


.58 


.49 


.45 


q31 


311 


37 


94 


180 


M 


.15 


.13 


.35 


.13 
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qafcon 












.26 








q6 


418 


52 


124 


28 


M 


.19 


.14 


.39 


.17 


qll 


281 


51 


266 


24 


M 


.42 


.44 


.49 


.35 


ql5x 


234 


160 


129 


99 


M 


.20 


.25 


.40 


.26 


ql9 


302 


75 


171 


7 4 


M 


.27 


.38 


.44 


.37 


q30 


41 


209 


215 


157 


M 


.34 


.57 


.47 


.48 


q33i 


284 


76 


78 


184 


M 


.12 


.29 


.33 


.34 



Scale standard deviation = 6.32; Cronbach alpha for scale = 0.85. 



Appendix 2 
Item analysis 1986 





Y 


N 


M 


Omit 


Corr< 


modtol 














250 


97 


105 


21 


Y 


qlO 


19 


434 


17 


2 


N 


ql5 


29 


353 


84 


6 


N 


q29 


322 


35 


79 


36 


Y 


q33 


307 


66 


60 


39 


Y 


q36 


48 


310 


62 


52 


N 


mval 












qi 


271 


63 


132 


6 


Y 


q8 


30 


413 


20 


9 


N 


ql3 


47 


389 


30 


6 


N 


q2i 


309 


79 


59 


25 


Y 


q25 


419 


9 


29 


15 


Y 


q34 


8 


393 


27 


44 


N 


denant 












q3 


222 


121 


121 


8 


M 


q7 


261 


77 


117 


17 


M 


ql2 


36 


340 


90 


6 


M 


ql7 


243 


83 


137 


9 


M 


q20 


19 


326 


120 


7 


M 


q28 


239 


54 


156 


23 


M 


minval 












q6 


244 


108 


112 


9 


M 


qll 


2 06 


138 


115 


13 


M 


ql8 


256 


74 


139 


3 


M 


q23 


235 


82 


141 


14 


M 


q26 


273 


47 


125 


27 


M 


q31 


276 


45 


118 


33 


M 


mathv 












q9 


383 


45 


38 


6 


Y 


q22 


157 


291 


11 


13 


N 


q27 


194 


195 


28 


55 


N 


ma thin 












q24 


45 


23 


394 


10 


M 


q30 


11 


66 


369 


26 


M 


q35 


132 


91 


197 


52 


M 


relv 












q4 


89 


315 


61 


7 


N 


ql4 


421 


14 


26 


11 


Y 


ql9 


32f 


40 


100 


4 


Y 


reli 












q2 


173 


38 


248 


13 


M 


ql6 


66 


41 


363 


2 


M 


q32 


349 


16 


64 


43 


M 



Scale standard deviation = 4.69; 
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It*. 



Diff Disc Item s.d. Item/scale corr. 



.70 








.53 


.45 


.50 


.34 


.92 


.11 


.27 


.18 


.75 


.30 


.43 


.24 


.68 


.32 


.47 


.30 


.65 


.44 


.48 


.38 


.66 


.28 


.47 


.24 


.77 








.57 


.41 


.49 


.31 


.88 


.24 


.33 


.29 


.82 


.26 


.38 


.25 


.65 


.47 


.48 


.36 


. 89 


.18 


. 32 


.30 


.83 


.28 


.37 


. 34 


. 26 








.26 


.31 


.44 


.34 


.25 


.09 


.43 


.10 


.19 


.13 


.39 


.14 


.29 


.31 


.45 


.27 


.25 


.30 


.44 


.27 


.33 


.39 


.47 


.35 


.26 








.24 


.34 


.43 


.35 


.24 


.35 


.43 


.34 


.29 


.31 


.46 


.32 


.30 


.35 


.46 


.37 


.26 


.31 


. 44 


.36 


.25 


.39 


.43 


.38 


.61 








.81 


.24 


.39 


.25 


.62 


. 29 


.49 


.29 


.41 


.30 


.49 


.27 


.68 








.83 


.35 


.37 


.37 


.78 


.35 


.41 


.39 


.42 


.46 


.49 


.37 


.75 








.67 


.46 


.47 


.34 


.89 


.22 


.31 


.28 


.69 


.43 


.46 


.36 


.48 








.53 


.28 


.50 


.22 


.77 


.45 


.42 


.43 


.14 


.16 


.34 


.18 



Cronbach alpha for scale = 0.71. 
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Appendix 3 
Item analysis 1987 





Y 


N 


M 


Omit 


Correct 


Diff 


Disc 


Item s.d. 


Item/ sea 


modpon 












.78 








q2 


250 


10 


99 


2 


Y 


.69 


.39 


.46 


.33 


q4 


270 


72 


14 


5 


Y 


.75 


.38 


.43 


.35 


ql4 


34 


278 


43 


6 


N 


.77 


.37 


.42 


.36 


ql6 


326 


7 


25 


3 


y 


.90 


.25 


.30 


.34 


ql9 


295 


12 


49 


5 


Y 


.82 


.31 


.39 


.34 


q32 


271 


11 


52 


27 


Y 


.75 


.34 


.43 


. 35 


modtol 












.63 










147 


104 


78 


32 


Y 


.41 


.48 


.49 


.36 


qlO 


49 


256 


53 


3 


N 


.71 


. 33 


.45 


.27 


ql5 


19 


264 


68 


10 


N 


.73 


.42 


.44 


.36 


q29 


253 


34 


53 


21 


Y 


.70 


.35 


.46 


.32 


q33 


219 


52 


55 


35 


Y 


.61 


.59 


.49 


.46 


q36 


47 


217 


52 


45 


N 


.60 


.49 


.49 


.40 


mval 












.76 








qi 


190 


60 


107 


4 


Y 


.53 


.41 


.50 


.31 


q8 


16 


320 


20 


5 


N 


. 89 


.27 


.32 


.31 


ql3 


40 


291 


24 


6 


N 


.81 


.22 


.40 


.25 


q21 


221 


56 


60 


24 


Y 


.61 


.45 


.49 


.36 


q25 


326 


5 


23 


7 


Y 


.90 


.19 


.30 


.28 


q34 


10 


286 


25 


40 


N 


.79 


.37 


.41 


.38 


denant 












.28 








q3 


162 


85 


108 


6 


M 


.30 


.25 


.46 


.23 


q7 


198 


87 


65 


1 1 


M 


. 18 


. 04 


.38 


.03 


ql2 


30 


252 


76 


3 


M 


.21 


-.06 


.41 


.04 


ql7 


190 


49 


113 


9 


M 


.31 


.19 


.46 


.18 


q2o 


12 


227 


114 


8 


M 


.32 


.22 


.46 


. 18 


q28 


174 


41 


128 


18 


M 


.35 


.33 


.48 


.29 


minval 












.29 








q6 


160 


97 


100 


4 


M 


.28 


.13 


.45 


.17 


qli 


167 


94 


93 




M 


.26 


. 26 


.44 


. 26 


ql8 


173 


69 


109 


10 


M 


.30 


.19 


.46 


.17 


q23 


142 


82 


123 


14 


M 


.34 


.32 


.47 


.28 


q26 


192 


44 


115 


10 


M 


.32 


.22 


.47 


.21 


q3i 


192 


59 


87 


23 


M 


.24 


.23 


.43 


.25 


mathv 












.54 








q9 


262 


40 


48 


11 


Y 


.73 


.32 


.45 


.27 


q22 


154 


182 


19 


6 


N 


.50 


.30 


.50 


.28 


q27 


165 


146 


25 


25 


N 


.40 


.19 


.49 


.19 


mathin 












.69 








q24 


31 


28 


292 


10 


M 


.81 


.35 


. 39 


.36 


q30 


10 


55 


281 


15 


M 


.78 


.36 


.42 


. 3 6 


q35 


91 


53 


169 


48 


M 


.47 


.55 


. 50 


.41 



Scale standard deviation = 4.51; Cronbach alpha for scale = 0.67. 
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Appendix 4 
Item analysis 1988 





Y 


N 


M 


Omit 


Correct 


Dif f 


Disc 


Item s.d. 


Item/sca 


modpon 












.80 








q2 


453 


13 


126 


1 


Y 


.76 


.23 


.43 


.24 




433 


108 


41 


11 


Y 


.73 


.32 


.44 


.27 


ql4 


47 


464 


79 


3 


N 


.78 


.34 


.41 


.34 


ql6 


556 


9 


24 


4 


Y 


.94 


.13 


.24 


. 25 


ql9 


498 


21 


68 


6 


Y 


.84 


.23 


. 37 


.28 


q32 


446 


19 


91 


37 


Y 


.75 


.40 


.43 


.37 


modtol 












.66 








q5 


282 


166 


108 


37 


Y 


.48 


.49 


.50 


.36 


qlO 


62 


433 


89 


9 


N 


.73 


.28 


.44 


.25 


ql5 


33 


453 


91 


16 


N 


.76 


.31 


.43 


.30 


q29 


404 


54 


101 


34 


Y 


.68 


.44 


.47 


.36 


q33 


390 


74 


61 


68 


Y 


.66 


.56 


.47 


.46 


q36 


60 


383 


77 


73 


N 


.65 


.41 


.48 


.37 



mva 1 .74 



qi 


311 


85 


184 


13 


Y 


.52 


.44 


. 50 


.34 


q8 


34 


512 


24 


23 


N 


.86 


.22 


.34 


.27 


ql3 


81 


475 


31 


6 


N 


.80 


.26 


.40 


.25 


q2i 


352 


96 


103 


42 


Y 


.59 


.44 


. 49 


. 34 


q25 


524 


21 


38 


10 


Y 


.88 


.19 


.32 


. 27 


q34 


9 


481 


44 


59 


N 


.81 


.32 


.39 


.34 


denant 












.26 








q3 


254 


152 


174 


13 


M 


.29 


.30 


.46 


.28 


q7 


301 


153 


112 


27 


M 


.19 


.11 


.39 


.12 


ql2 


48 


431 


105 


9 


M 


.18 


.08 


.38 


.10 


ql7 


304 


101 


176 




M 


.30 


.22 


.48 


.23 


q20 


21 


405 


159 


8 


M 


.27 


.22 


.44 


.23 


q28 


310 


70 


186 


27 


M 


.31 


.28 


.46 


. 28 


minval 












.29 








q6 


259 


164 


159 


11 


M 


.27 


.31 


.44 


.30 


qll 


278 


153 


146 


16 


M 


.25 


.26 


.43 


.27 


ql8 


276 


106 


200 


11 


M 


.33 


.20 


.47 


.20 


q23 


258 


139 


179 


17 


M 


.30 


.24 


.46 


.24 


q26 


309 


61 


198 


25 


M 


.33 


.26 


.47 


.22 


q31 


327 


76 


150 


40 


M 


.25 


.35 


.44 


.34 


mathv 












.55 








q9 


451 


69 


58 


15 


Y 


.76 


.32 


.43 


.26 


q22 


267 


303 


11 


12 


N 


.51 


.29 


. 50 


.27 


q27 


251 


223 


40 


79 


N 


.38 


.32 


.48 


.24 


mathin 












.63 








q24 


59 


56 


465 


13 


M 


.78 


.44 


.41 


.39 


q30 


22 


76 


468 


27 


M 


.79 


.38 


.41 


.39 


q3 5 


174 


89 


249 


81 


M 


.42 


.51 


.49 


.42 



Scale standard deviation = 4.57; Cronbach alpha for scale = 0.69. 
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Y 


N 


M 


Omi 


modpon 










q2 


482 


11 


126 


3 


q4 


487 


93 


33 


9 


ql4 


44 


503 


63 


12 


Ql6 


587 


7 


19 


9 


ql9 


529 


14 


63 


16 


q32 


447 


30 


85 


60 


modtol 










q5 


316 


143 


114 


49 


qlO 


62 


454 


96 


10 


ql5 


26 


472 


98 


26 


q29 


430 


44 


109 


39 


q33 


407 


65 


86 


64 


q36 


60 


412 


64 


86 


mval 










qi 


330 


93 


181 


18 


q8 


18 


554 


34 


16 


ql3 


84 


490 


35 


13 


q21 


399 


79 


86 


58 


q25 


532 


18 


59 


13 


q34 


12 


497 


41 


72 


denant 










q3 


277 


155 


177 


13 


q7 


329 


150 


115 


28 


ql2 


39 


449 


119 


15 


qi7 


317 


89 


195 


21 


q20 


22 


398 


186 


16 


q28 


327 


81 


184 


30 


minval 










q6 


246 


171 


189 


16 


qll 


252 


158 


188 


24 


ql8 


269 


111 


22] 


21 


q23 


266 


132 


199 


25 


q26 


322 


67 


207 


26 


q31 


311 


67 


207 


26 


mathv 










q9 


469 


67 


59 


27 


q22 


245 


326 


24 


27 


q27 


234 


250 


50 


88 


math in 










q24 


59 


74 


474 


15 


q30 


17 


111 


462 


32 


q35 


165 


89 


277 


91 



Scale standard deviation 
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Appendix 5 
Item analysis 1989 

Correct Diff Disc 





.81 




Y 


.77 


.29 


Y 


.78 


.25 


N 


.81 


.34 


Y 


.94 


. 1 5 


Y 


.85 


.27 


Y 


.72 


.53 




.67 




Y 


.51 


. 43 


N 


.73 


.30 


N 


.76 


.27 


Y 


.69 


.37 


Y 


.65 


.56 


N 


.66 


.49 




.75 




Y 


.53 


.41 


N 


.89 


.21 


N 


.79 


.25 


Y 


.64 


.44 


Y 


.86 


.26 


N 


.80 


.46 




.26 




M 


.28 


.36 


M 


.18 


. 1 1 


M 


. 19 


.07 


M 


.31 


.27 


M 


.30 


.29 


M 


.30 


.33 




. 32 




M 


.30 


.29 


M 


.30 


.35 


M 


.36 


.31 


M 


.32 


.31 


M 


.33 


.39 


M 


.28 


. 31 




. 56 




y 


. 75 


.33 


N 


.52 


.45 


N 


.40 


.37 




.65 




M 


.76 


.41 


M 


.74 


.41 


M 


.45 


.55 



= 5.01; Cronbach alpha 



34 



35 



Item s.d. Item/scale corr. 

.42 .28 

.41 .25 

.39 .34 

.23 .31 

.36 .34 

.45 .47 

.50 .33 

.44 .26 

.43 .27 

.46 .36 

.48 .45 

.47 .41 

.50 .32 

.31 .25 

.41 .26 

.48 .35 

.35 .36 

.40 .46 

.45 .33 

.39 .10 

.39 .08 

.46 .24 

.46 .27 

.46 .30 

.46 .28 

.46 .32 

.48 .30 

.47 .31 

.47 .35 

.45 .31 

.43 .30 

.50 .35 

.49 .30 

.43 .39 

.44 .41 

.50 .42 

scale = 0.74. 



